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- The MAILING DA TE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THEMAILINGDATE OF THIS COMMUNICATION; — 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )K Responsive to communication(s) filed on 22 November 2004 . 
2a)E3 This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1,3-7,9. 1 1-26 and 28-32 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1.3-7.9.11-26.28-32 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

1 2) Q Acknowledgment is made of a claim for foreign priority under 35 U .S.C. § 1 1 9(a)-(d) or (f). 
a)D All b)Q Some * c)Q None of: 

1 .□ Certified copies of the priority documents have been" received. 

2.0 Certified copies of the priority documents have been received in Application No. . 

3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1 ) □ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5 ) □ Notice of Informal Patent Application (PTO-152) 

Paper No(s)/Mail Date . 6) □ Other: . 
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DETAILED ACTION 

1. ~ Thisaction is responsive to amendment filed— 1 1/22/04. — _ .... _ _. 

2. Claims 1 , 3-7, 9, 1 1-26, 28-32 are pending in the application. 

Claim Rejections - 35 USC § 112 

3. The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 1 , 9, 21 and 22 are rejected under 35 U.S.C. 112, first paragraph, as 
failing to comply with the written description requirement. The claim(s) contains subject 
matter "talking with the transformed audio of the user on an output display device" which 
was not described in the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor(s), at the time the application was filed, had 
possession of the claimed invention. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-7, 9-14, 21 and 22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ritchey (5,495,576) in view of Dutta et al. (6,453,294). 
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Claim 1, Ritchey discloses capturing motion of a user (records action from a 
participant 24; colrl 8; lines-1 6-20); capturing audio of-the user (receives recorded audio 
signals from the panoramic 3D audio input system; col. 8, lines 30-36); Ritchey does not 
teach transforming the audio into a different gender; however, Dutta et al. teaches 
transforming audio (adding, removing or changing an accent, changing a child's voice, 
and changing a male voice to female voice to a different speech pattern (col. 3, lines 17- 
36); and Ritchey teaches animating a character with the motion and transformed audio 
in real-time (col. 31, line 21 through col. 32 line 2); rendering the character animated 
with the captured motion of the user on an output display device (col. 31 , line 35 
through col. 32, line 2). It would have been obvious to one of ordinary skill in the art at 
the time the invention was made to incorporate transcoding input audio and/or video 
taught by Dutta into audio-visual system of Ritchey for transforming male voice to a 
female voice, because transforms are used for transcoding input text, audio and /or 
video input, it would provide a choice of audio and/or video output (col. 1 , lines 55-57). 

Claims 3-7, 12-14, Ritchey teaches attaching multiple motion tracking sensors to 
areas of the user to track the user's movements (col. 9, lines 33-40); transmitting 
signals representing the movements from the sensors to a computer (transmitting 
signals into computer 9; col. 18, lines 54-61); attaching a wireless microphone to the 
user. (col. 14, lines 40-50); altering pitch characteristics of the audio (col. 31, lines 47- 
51); applying the motion to a 3D model (3D model 14 is updated of participant actions; 
col.17, lines 40-51); combining the transformed audio to the 3D model (the sensor 
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recordings are processed by audio processing system 23 and added to existing model; 
- - — col. 9, lines-37-45). - — - — - - - - ----- ■— - _ ... .._ ._ _. 

Claim 9, the rationale provided in the rejection of claim 1 is incorporated herein. 
In addition, Ritchey teaches generating a 3D model of a character (col. 28, lines 64-66); 
Ritchey does not teach modifying a gender of the audio; however, Yamamoto teaches 
modifying (is amplified filtered) a gender of the audio of the user (col. 7, lines 25-43). It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to incorporate modifying a gender of the audio taught by Yamamoto into the 
virtual reality audio-visual system by Ritchey's method for creating a virtual reality 
presentation, because it would provide a virtual system for animation sequence of the 
character based upon the input voice signal and the expression signal (col. 3, lines 40- 
41). 

Claim 11 , the rationale provided in the rejection of claim 3 is incorporated herein. 
In addition, Ritchey teaches transmitting magnetic fields representing the movements 
from the sensors (col. 19, lines 26-27; col. 23, lines 35-51). 

Claims 21 and 22, the rationale provided in the rejection of claims 1 and 9 is 
incorporated herein. In addition, Ritchey teaches a computer readable medium (col. 20, 
lines 32-43). 

6. Claims 1 5, 1 6 and 1 8-20 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Yamamoto (5,923,337) in view of Dutta et al. (6,453,294). 

Claim 15, Yamamoto teaches a presentation system (col. 6, line 35; fig. 1), 
comprising: a motion tracking device (an audience survey camera device 128; col. 6, 
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lines 41-42; fig.1); an audio receiving device (microphone 130; col. 6, line 43); an audio 
- receiver/converter ^ 
gender; Yamamoto does not teach transform the audio into audio of a different gender; 
however, Dutta et al. teaches transforming audio (adding, removing or changing an 
accent, changing a child's voice, and changing a male voice to female voice to a 
different speech pattern (col. 3, lines 17-36); and Yamamoto teaches a system to 
produce an animated 3D character from the motion and converted audio (col. 6, lines 
46-51 ). It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate transcoding input audio and/or video taught by Dutta 
into audience system of Yamamoto for transforming male voice to a female voice, 
because transforms are used for transcoding input text, audio and /or video input, it 
would provide a method to alter identifying audio attributes of a participant during 
interactive communications, whether textual, audio of motion video (col. 1, lines 50-53). 

Claims 16 and 18-20,Yamamoto teaches an output device (presentation display 
monitor 124; col. 6, lines 38-40); the audio receiving device is a wireless microphone 
136 (col. 6, lines 45-46; fig. 1), the audio receiver/converter comprise an audio effects 
digital signal processor (the digitized voice signal is preprocessed by a wave 
preprocess; col. 8, lines 19-26). 

7. Claim 17 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yamamoto (5,923,337) in view of Dutta et al. (6,453,294) and further in view of Ritchey 
(5,495,576). 
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Claim 17, Yamamoto does not teach eye tracking device; however, Ritchey 
teaches-motion tracking device(eyetracking device) comprises a set of_interconnected_ 
sensors affixed to the user (head sensor 76a, glove sensors 76b, 76c; col. 25, lines 18- 
47); a transmitting device (data is transmitted to the computer 9 via conductors 82a and 
82b; col. 24, lines 48-55). It would have been obvious to one of ordinary skill in the art at 
the time the invention was made to incorporate the motion tracking device taught by 
Ritchey into the real-time presentation system of Yamamoto for using motion tracking to 
create a virtual reality presentation, because using eye sensors which monitors 
movements of the wearer's eyeballs and it would transmit signals representing 
movements to computer via conductor for creating virtual reality presentation (col. 25, 
lines 41-44). 

8. Claims 23-30 and 32 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ritchey (5,495,576) in view of Yamamoto (5,923,337). 

Claims 23, 26, Ritchey teaches detecting motion (detects and tracks a target 
subject 13 in space; col. 33, lines 8-9); Ritchey does not teach detecting audio; 
however; Yamamoto teaches detecting a volume change of the voice input over a unit 
time (col. 3, lines 54-55); modifying a fundamental frequency of the audio (fig. 7A); and 
Ritchey teaches altering the audio (altering the index of refraction as they change pitch 
and advance; col. 31, lines 47-51); synchronizing the motion of the user to an animated 
character; synchronizing the altered audio of the user to the animated character (col. 
33, lines 26-32). It would have been obvious to one of ordinary skill in the art at the time 
the invention was made to incorporate detecting a volume change of the voice (audio) 
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taught by Yamamoto into the virtual reality audio-visual system by Ritchey's method for 

— -creating a-virtual reality presentation, becauseit would provide-a virtual-system for_ _ 

animation sequence of the character based upon the input voice signal and the 
expression signal (col. 3, lines 40-41). 

Claims 24, 25, the rationale provided in the rejections of claims 3, 4 are 
incorporated herein. 

Claims 28-30 and 32, Ritchey discloses the output device is a projector, a 
projection screen (col. 35, lines 5-7); the output device is a flat panel plasma monitor 
(col. 35, lines 5-7). 

9. Claim 31 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ritchey 
(5,495,576) in view of Yamamoto (5,923,337) and further in view of Doval et al. 
(6,476,834). 

Claim 31, Doval et al. teaches the output device is an electronic white board (col. 
2, lines 43-46). It would have been obvious to one of ordinary skill in the art at the time 
the invention was made to incorporate the devices such as "digital white boards" taught 
by Doval into a virtual reality audio-visual system and method by Ritchey's teaching for 
creating a virtual reality presentation, because using electronic white board, it may have 
a digitizing writing surface and a PC interface that permits transfer of digital information 
from the white board to a PC. The user can then fax, e-mail or import the information 
into other programs (col. 2, lines 43-48). 

Response to Arguments 
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1 0. Applicant's arguments filed 11 /22/04 have been fully considered but they are 

_ — not persuasive, because-claim -1 , Dutta-teaches that -Transformed are used_for_ ._ 

transcoding input text, audio and/or video input to provide a choice of text, audio and/or 
video output. Transcoding may be performed at a system operated by the 
communications of originator, an intermediate transfer point in communication path and 
one or more systems operated by the recipients. Transcoding of the communications 
input, particular voice and image portions to create an avatar for a user originating the 
communications input; col. 1, lines 54-64. In computer animated environment, chat 
environments are virtual 3D chat, in which computer users interact with each other 
(client A, client B, client C, client D via chat server or Internet) through animated 3D 
virtual actors (sometimes called avatars) and chat room is a virtual reality presentation. 
Dutta suggests that: " Intelligent speech-to-speech transforms alter identifying speech 
characteristic and patterns to provide an avatar to the speaker, contextual mapping of 
speech input to a different speech characteristic (changing a child's voice to an adult's 
voice; changing a male voice to a female voice" (col. 3, lines 17-36). Further, Dutta 
teaches: "Chat server 206 utilizes transcoders 208 to transform communications input 
as necessary for multicasting to all participants" (col. 4, lines 54-65). 

The amendments of claims 1, 9, 21 and 22 have not been considered because 
the claims contains subject matter "talking with the transformed audio of the user on an 
output display device" which was not described in the specification in such a way as to 
reasonably convey to one skilled in the relevant art that the inventor(s), at the time the 
application was filed, had possession of the claimed invention. 
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THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded 

- of-the extension of time policy as set forth-in37_CFR-1.136(a)._ _. . 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kimbinh Nguyen whose telephone number is 
(571)272-7644. The examiner can normally be reached (Monday- Thursday from 7:00 
AM to 4:30 PM and alternate Fridays from 7:00 AM to 3:30 PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Zimmerman, can be reached at (571)272-7653. 
Any response to this action should be mailed to: 
Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
Or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 
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Hand-delivered responses should be brought to Crystal Part II, 2121 Crystal Drive, 
ArJington,_VA,_Sixth_Eloor_(Receptionist).. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 306-0377. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



March 29 2005 




KIMBINH T. NGUYEN 
PRIMARY EXAMINER 



